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ArKGROUN^ ™ TNVENTION 



Background Art 



100011 Tie present invention relates generally to the field of object detection, evaluatton and 
counting. More particnlarly, the invention relates to a system and method for detecttng the 
presence of a passing object, providing an image of the object and utilizing the nnage to 
identifiably include the object in an overall count 

100021 It is known in the art to utilize light emitting sources and photo detectors to detect the 
presence of a passing object. For example, in the manufacture of pharmaceutical pills, a 
dispensingmachinetaown asaslat filler is utilized for filUngpiUbottles. border to detenntne 

how many pills are fed into a botfle, a number of inspection apparatus have been coupled to or 
around the slat machine. 

,00031 inspection apparatus have typically been optical counters. Some of the optical counters 
have r«,uired a feed system that ensures that the objects, which are to be counted, are presented 
across a photo detection device in a single file. Further still, such systems have reqmred that the 
obj«=ts are spaced a sufficient distance apart to allow discrete passing of objects between a hgfct 
source andasensor. Such system interfere with the packaging process byplacingconstramts on 

me feed rates of the pills and requiring mechanical adaptations to the bottle fiUer. TTe accuracy 
of such systems is also an issue with respect to miscounts caused by shadows and other 
interference. In an attempt to overcome some of these limitations other counting systems were 
implemented. 

100041 For example, m some prior art systems an array of light sensitive elements have been 
provided to measure by triangulation, individual distances to successively scanned pomts on the 
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.^aoeofapassi„gobiec..Wob*ng^si«onda.fortt,esca„nedpo»KThep^^^^^^ 

4e scann^ points. «.e *e triangulaUon «eU.od unproved acouracy and p^per d^«.on 
a„ac.^obieo.U.epr„b.e„>s«.a«ng«,U.eb™chi„gofpmsa„d«.e.oca«onofs„chde.een» 

relative to the opening of the bottte remain unresolved. 

,M«5, Other prior art systems have incorpora^d a bank of at leas, two linear arrays which 
extend in the dir^tion of dte reflected Ught beam. Tlte arrays are positioned such mat a hght 
beam from thescannedpointscanstraddleoverthelineararrays. By utilizing a scheme of 

creating defmite subdivisions of light receiving elements, the prior art system produces a c<^ed 
slgnalLcanbereadilyinten-retedbyrelattvely simple circuitry. Nonetheless suchs^^^^^ 
tTere^ulredthe addition of supplementary hardwareto the slat fmermachinemthef^nnofptn 
purgebars.Furfl.erstiU, this and other countingsystemshavenot provided countingofthe 
objects and rather have focused onmerelyjnstdetecti„n.E,entather.theseprior art syst^s 

have not utilized image captures to identify and count objects. 

,00061 Accordingly, there exists a need tor an improved method and system to pro,.de object 
Lts inmanufi^mringp^-eess. whereinthe system is easily configured to suit t^e dtmenstons 
of intended articles of manufactare as well as the manufechmng equipment. Further there ,s a 
need for a system that is able to accurately identify objects that are to be counted and to count the 



objects. 
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100071 The present invention is directed to a system and method for use in a computing 
enviromnent to provide object counts by utilizing object images. Objects are detected and 
images are captured using aprogrammable array of Ught sources and photo detectors. THe 
images are compared against known images to ascertam the identity of the objects and 
subsequently count the objects. 

100081 In one aspect of present invention, an optical system for identifying one or mote 
objects comprising a grouping of a light source array and an array of photo detectors into 
multiple zones is provided. Also provided is a means for rapidly strobing the light source array 
and scanning the photo detectors within each of the multiple zones to capture a plurality of data 
values as one or more target objects pass throu* the zones. Utilizing the data values, an image 
of the target object is captured The image is then used to identify the object. Images can also be 
presented to an operator on a display. 

[00091 In another aspect of the invention the captured image is used to maintain a count of the 
identified objects. The image is also used to determine the opacity of the object and thus in 
certain applications provides information on whether an object is empty. 

lOOlO] hi a fiirther aspect, the captured images of the falling object are compared with images of 
know objects through a method that utilizes pixel counts and scan lines. The pixel counts are 
influenced by the luminance of individual pixels. 

100111 m yet another aspect captured images can be stored as part of a diagnostic process. The 
diagnostic process also allows other data about an object such as, pixel count and scans, to be 
collected by the system for future use. 

(00121 These and other advantageous features of the present invention will be in part apparent 
and in part pointed out herein below. 
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nFSrRTPTION ™ DRAWINGS 

[00131 For a better understanding of the present invention, reference may be made to the 
accompanying drawings in which: 

10014] FIG. 1 is an illustration ofaslat bottle filler having the zoned arraypixel counter of the 
present invention; 

[0015] FIG. 2 is a block diagram illustrating the components and architecture for the components 
of the present invention; 

[00161 FIG. 3 is a block diagram of an exemplary operating enviromnent for practicing the 
present invention; 

[00171 FIG 4A is a flow diagram illustrating the process implement by the system and method 
of the present invention; 

[00181 FIG 4B is a detailed portion of the pixel scan and image capture step of the flow diagram 
ofFIG.4A. 

[0019] FIG 4C is a detailed portion of the image analysis step of the flow diagram of FIG. 4A. 

[0020] FIG. 5 is a display of an exemplary screen for providing system diagnostics and settip 
parameters. 

[00211 FIG. 6A is a display of an exemplary screen for mapping zones in an embodiment of the 
present invention; 

[00221 FIG. 6B is a display of an exemplary screen for specifying threshold values for section 
pixels in an embodiment of the present invention; 
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[00231 FIG. 6C is an exemplary display screen of zone counts in an embodiment of the present 
invention; 

[00241 FIG. 6D is a display screen of invalid zone counts in an embodiment of the present 
invention; 

[00251 FIG. 6E is a display of a screen for displaying captured piU objects in an embodiment of 

the present invention; 
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,00261 The present invention relates to a system and method for detecting the presence of a 
passing object, providing an image of the object and utiHzing the image to identiflably mclnde 
the object in an overall count. 

[0027] According to the embodiment(s) of the present invention, various views are illustrated in 
Fig i-4andlikereferencenurneralsarebeingusedconsistentlythroughouttorefertohkeand 

corresponding parts of the invention for all of the various views and figures of the drawing. 
Also please note that the first digit(s) of the reference number for a given item or part of the 
invention should correspond to theFig. number in which the item orpart is first identified. 

[00281 The present invention detects, evaluates and counts objects as the objects pass a wide 
area linear scanning device. THe scamiing device is capable of detecting multiple objects of 
varying dimensions. The scamimg device comprises among other things an array of photo 
detectors which can be programmatically grouped into zones. THe zones can be expanded or 
shrunk on the basis of the size of the objects that are to be counted. Objects are generally 
detected through strobing a light source and rapidly scamiing zoned detectors to measure the 
change inlight between the source and the photo detectors of the zone, hnages of the passing 
object are created from the scanning process and are utilized in identifying the passing objects. 

The opacity of passing objects is also determined by tiie present invention. 

[00291 Having briefly provided an overview of the present invention, one embodiment of tiie 
invention will be discussed witiireference to Figs. 1-6. An exemplary operating enviromnent 
and architectiire for tiie present invention is first described below. 

[00301 The details of tiie invention and various embodiments can be better understood by 
referring to the figures of the drawing. Referring to Fig. 1. diagrams representative of atypical 
slat bottle filler implementing a graphical user interface and tiie system and metiiod of tiie 
present invention are shown. The present invention should not be interpreted as having any 
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dependency or r«,uiren.ent relating to »ny one or eombiiudon of components illustrated in me 

exemplary enviromnent 100. 

[00311 Referring to FIG. 1. a fiontal view 102 and a cross sectional view 104 of the components 
for counting objects on a slat filling machine generaUy indicated by the reference number 100 
are illustrated. A rotating slat feeder 106 is shown with pills 108 contained in a plurahty of 
cavities 1 10. to operaHon. the pills 108 fall from the cavities 1 10 as the slat feeder 106 rotates. 
As each pUl 108 falls, it proceeds down one of a plurality of product paths 1 12 mto a hopper 1 14. 
The illustrated bottle filler is capable of supporting two lanes of bottles for each hopper 1 14. As 
such, there is a manifold gate 116 with the hopper 1 14 to divert the pills to the front lane bottle 
1 18 or the rear lane bottle 120 via the appropriate lower manifold 122a or 122b. 

100321 to the preferred embodimem of the present mvention, the object counting apparatus is 
located immediately above the hopper 1 14, thus allowing the counting to be performed at a 
locaHon that is closer to the bottle unlike tradition comitmg systems. Counting closer to the 
botUe mmimizes the chances that pills which have been counted may not end up in the bottle. 
The object counting apparatus creates a set^mg plane 126, between a row of Ught sources 122 
and an opposite row of photo-detectorsl24. As illustrated in the view 102, the sensing plane 126 
may be substantially perpendicular to the light sources 126 and photo^etectors 124. Irrespective 
of the relative position of the sensing plane 126, the objective is that pills 108 that Ml from the 
cavities 1 10, will cross the sensing plane 126. 

[00331 The sensing plane 126, row of light sources 122 and row of photo-detectors 124 generally 
extend across a region spanning the longitudinal length of the slat feeder 1 06. This region is 
referred to herein as sensing zone 130. In the preferred embodimentofthe present invention, the 

row of photo-detectors 124 forms an array that is approximately forty inches long. Tlie array 
length is variable and is typically selected to match the dimensions of the slat filler machine. 

[00341 Within the sensing zone 130 are individually configurable counting zones. There may be 
sixty to one hundred and twenty counting zones per forty-inch array to match standard slat 
spacing. However, there are some constraints on the minimum and maximum width for the 
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counting zones. In the preferred embodiment of the invention, a minimum zone wtdth of 
approximately 0.25 inches and a maximum zone ^dth of approximately 1.0 inches are des.rable. 
Sensing pixels should preferably be spaced approximately every 1/16 of an inch. 

[00351 Turning to the ftont view 104, the span of the sensing zone 130 and the relative position 
of the product paths 112 are illustrated. The sensing zone 130 comprises a continuous array of 
pixels in the profited embodiment, sixteen pixels are positioned in every inch of the forty mch 
sensing zone 130. The illustrated product path. 112 may vary for each hopper 114. Asshown, 
product paths 112 a and 1 12 b are differont for each of hoppers 114a and 114b. Also shown m 
this view, is that the product paths 1 12 associated with a particular hopper 1 14 occupy only a 
portion of the sensing zone 130. 

100361 In connection with the product paths 112 there are counting zones 132a and 132b, which 

are collectively referenced as counting zones 132. For example, counting zones 132a are 
established in connection with the product pathsll2aofhopperll4a. As shown, the hopper 

1 14a has five counting zones 132. On the other hand, hopper 1 14b has eight counting zones 132. 
The purpose and significance of the zones will be discussed later in this document. 

[00371 In the preferred embodiment of the present invention, a plurality of LEDs 122 are 
packaged into an array to serve as a light source for the sensing zone 130. Photo detectors 124 
that are one sixteenth of an inch (1/16 inch) in width are packaged into an array and set up to 
detect light origination from the light source. Tlie arrangement of the light source and detectors 
is provided to allow readings from the detectors to be taken and utilized in detecting and 
counting passing objects. FIG. 2 illustrates architecture of the preferred embodiment for 
capturing and processing the information gathered from the arrangement. 

10038] For each inch of photo-detectors there is a group arrangement 206 that comprises a pixel 
processor 204, Analog-to-Digital (A/D) converters 202, light source 122, and photo detectors 
124. hi the preferred embodiment of the present invention each of the photo detectors 124 
represent pixels. As illustrated, there are sixteen photo detectors or pixels - group detectors 
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129 within the group arrangement and thus the same for every inch of the seamier. Withm the 
group arrangement 206 there isapixel processor 204. Light emitted bythe light source 122 IS 

detectedbythephotodetectors 124. When an object falls between the light source and the photo 
detectors 124, some pixels will be obstructed and thus receive no light, some will be miaffected 
and yet others may be partially obscured. An analog signal corresponding to the degree of 
luminescence or darkness is provided by each pixel and passed to the A?D converter 202. 
Equivalent distal signals of the received analog signals are provided from the A/D converter 202 
to the pixel processor 204. THe pixel processor 204 performs threshold comparisons of the 
received values against programmed values to determine the count of pixels that meet the cntena 
representedbytheprogrammedvalues. This enables a binary bit to be set for each bit. Sixteen 
bits, each representing a pixel are presented to a section communication processor 208. 

100391 A collection of eight group arrangements 206 are preferably combined into a section. In 
other words, a section would have 128 pixels (8*16 pixels per inch). For each section there is a 
communications processor 208. The commmiications processor 208 communicates with the pixel 
processors 204 via a high speed hitegrated Circuit (IC) bus comiection, which is local to the 
section board. 

[0040] The commmiication processor 208 receives 16 bits of pixel states from each of eight pixel 
processors 204 in the section. THe communication processor 208 determines which counting 
zone 132 the pixel is accumulated into and accumulates the blocked pixels that meet threshold 
and the total numbers of scans performed for that zone. THe scans and pixel counts are ultimately 
transmitted via an interface card such as Ethernet processor 210, to a personal computing device 
212. At the personal computing device 212 the received data packets containing information on 
scans, pixel counts, and zone data may be displayed or otherwise processed. 

[00411 An exemplary personal computing device 212 for performing certain features of the 
present invention is presented in FIG. 3. THe computing system device 212 is only one example 
of a suitable computing environment and is not intended to suggest any limitation as to the scope 
of use or ftmctionality of the invention. 
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[00421 In that regard, the present inventionmay be described in the generals 

executable instn^ctions. such as program modules, being executedbyacomputer or proc^^^^^^ 

device Generally, program modules include routines, programs, objects, components, data 
structures, etc. that perform particular tasks or implement particular abstract data types. Those 
skilled in the art will appreciate that the invention maybe practiced with other computer system 

configurations, including hand-held devices, multiprocessor systems, microprocessor-based or 
programmable consumer electronics, minicomputers, mainfirame computers, and the like. THe 
invention may also be practiced in distributed computmg enviromnents where tasks are 
performed by remote processing devices that are linked through a communications network. 
When operating in a distributed computing enviromnent, program modules may be located m 
both local and remote computer storage media including other memory storage devices. 
Additionally, various fimctions that will be described herein may be implemented by modules 
that exist wholly or partially on a cUent system or a server. 

[0043] Figure 3 iUustrates an example of a suitable computing system enviromnent 300 on 
which the invention may be implemented. The computing system enviromnent 300 is only one 
example of a suitable computing enviromnent and is not intended to suggest any limitation as to 
the scope of use or functionality of the invention. Neither should the computing enviromnent 
300 be interpreted as having any dependency or requirement relating to any one or combmation 
of components illustrated in the exemplary operating environment 300. 

[00441 With reference to FIG. 3, an exemplary system 300 for implementing the invention 
includes a general purpose computing device in the form of a computer 212 including a 
processing unit 302, a system memory 304, and a system bus 3 1 6 that couples various system 
components including the system memory to the processing unit. Importantly, the vanant of the 
computer 212 utilized as the client PC must support a playback mechanism and data rates 
suitable for high end image rendering. 

[00451 Computer 212 typically includes a variety of computer readable media, which may 
comprise computer storage media and communication media. THe system memory includes 
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computer storage media in the form of volatile and/or nonvolatile memory such as read only 
memory (ROM) and random access memory (RAM). A basic input/output system (BIOS), 
containing the basic routines that help to transfer information between elements within computer 
212, such as during start-up, is typically stored in ROM. RAM typically contains data and/or 
program modules that are immediately accessible to and/or presently being operated on by 
processing unit 302. For iUustrative purposes, FIG. 3 depicts operating system 306, application 
programs 308, other program modules 310, and program data 312. 

[00461 The computer 212 may also include other removable/non-removable, volatile/nonvolatile 
computer storage media. Such removable/non-removable, volatile/nonvolatile media may 
include a hard disk drive, a magnetic disk drive, an optical disk drive, a CD ROM or other 
optical media. Other removable/non-removable, volatile/nonvolatile computer storage media 
that can be utilized include, but are not limited to, magnetic tape cassettes, flash memory cards, 
digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. 

[00471 The drives and their associated computer storage media discussed above and illustrated in 
FIG. 3, provide storage of computer readable instructions, data structures, program modules and 
other data for the computer 212. A user may enter commands and information into the computer 
212 through input devices such as a keyboard, pointing device or scripting interface. Other 
input devices may include a microphone, joystick, game pad, satellite dish, seamier, or the like. 
These and other input devices may be comiected by other interface and bus structures, such as a 
parallel port, game port or a universal serial bus (USB). A monitor 3 14 or other type of display 
device is also comiected to the system bus 316 via an interface, such as a video interface 318. In 
addition to the monitor 3 14, computers may also include other peripheral output devices such as 
speakers, and printers, which may be comiected through a output peripheral interface. 

[00481 Hie computer 212 in the present invention will operate in a networked enviromnent using 
logical comiections to one or more remote computers. The remote computer may be a personal 
computer, and typically includes many or all of the elements described above relative to the 
computer 212. The logical comiections depicted in FIG. 3 include a local area network (LAN) 
and a wide area network (WAN) , but may also include other networks. 
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(00491 When used in a LAN networking environment, the computer 212 is eomtected to the 
LAN throu^ a network interface or adapter. When used in a WAN networking enviromneat. 
the computer 212 typically includes a modem or other means for estabUshing commumcattons 
over the WAN, such as the Internet. In a networked enviromnent, program modules depicted 
relative to the computer 212. or portions thereof, may be stored in the remote memory storage 
device. It will he appreciated that the network com>ections shown are exemplary and other means 
of establishing a communicattons link between the computers may be used. 

10050) Although many other internal components of the computer 212 are not shown, those of 
ordinary skill in the art will appreciate that such components and the intercomtccuon are well 
known. Accordingly, additional details concerning the internal construction of the computer 212 
need not be disclosed in connection with the present invention. 

[0051] Having pravided a broad overview and introduced the enviromnent, devices and 
nomenclature, the process of the present invention can better be understood and will be discussed 
with reference to How diagrams and screen illustrations in HGS. 4-«. 

[0052] Turning initially to FIG. 4A, a process now diagram of the present invention is 
illustrated. As shown and as described earUer, pixels representative of photo-detectors 124 are 
first gtouped into sections and ultimately into zones, at step 402. In the preferred embodiment, 
zones of pixels are defined to coincide witi, product paths. In other words, a zone is a vston area 
between physical pill dividers. Pixels that are located in flx,nt of flie dividers are unused by flie 
system These pixels are assigned to a set-aside zone number 32 (20 Hex). Aside fiom thts, any 
of the 128 pixels in a section may be mapped to any of up to 32 other zones identified as Zone 0 
through Zone 31. This option is iUustrated at step 404. Zones may be mapped as shown m FIG. 
6A. 

(00531 FIG 6A illustrates a zone mapping screen display 600. As shown, mapping screen 600 
provides a user witi, the ability to assign any one of the 128 pixels of a currenUy selected section, 
to apartieular Zone. In tins embodiment, tiie zone mapping numbers are desigmrted m 
hexadecimal i.e. 0-31 are represented as 0 - IF. Zone 32 (20 Hexadecimal) is reserved for tire 
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unused or otherwise obstructed pixels. Hie table below illustrates the zone configuration defined 
for the first sixteen pixels in the section of display 600. 




10054] Assigning a pixel to Zone 20 Hex effectively turns the pixel off. The pixel is unused 
typically because a pill divider covers the pixel either M\y of partially. Such a pixel need to be 
excluded from the processmg that takes place. For example, the illustrated pixels 1, 2, 3, 8, 15 
and 16 shown in table above and on screen 600 would be ignored during any scan of the affected 
zones. Pixels 4, 5. and 6 would be accumulated to form an image for pills dropping in Zone #1 . 
Pixels 9 - 14 would likewise be accumulated for pills dropping in Zone #2. All pixels are 
effectively mapped to a Zone # as shown in display 600. 

[00551 Returning to FIG. 4A, at step 406, the system monitors for a triggering event within the 
zone. It should be understood that step 406 and the subsequent steps are performed for each of 
the zones 1 to N that are configured. In response to the triggering event, the pixels within each 
zone are repeatedly scamied, at step 408. THe scamiing allows the pixels to be evaluated and an 



image 
FIG. 4B. 



of the falling object to be captured. The scanning and capture processes are illustrated in 



[00561 FIG. 4B illustrates step 408 in a flow diagram 425, i.e. the process for repeated scanning 
and image capture. As shown, at step 426, the pixels of a particular zone are scamied at a 
frequency rate of up to approximately 2 kHz. THe light source is strobed synchronously with the 
scamiing of the photo detectors. The scamiing continues mitil a succession of scans, preferably 
four scans result in readings that indicate no obstruction of the light that is incident on the 
detectors. Each scan results in an analog value for each of the pixels in the zone. At step 428, the 
analog values are converted to a digital pixel value. If the system is operating in a diagnostic 
mode as determined at step 432, then the pixel values are stored for later use, at step 430. On the 
other hand, if the system is operating in the normal counting mode, the process continues to step 



410 of FIG. 4A. 
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,00571 Step4.0mvolvesananalysis of wheteorncfte seined pixels «p«^.a good 
l!^-. TLi.,doa.epixels,nee.U,eo*eriaofwha.isa*n»l«.aasooade.eo.o„. F^er 

detaite on how this is accompUshed are illustrated in FIG. 4C. 

100581 no. 4C illustrates in a flow diagram the process of step 4.0 i.e. the process for analyzing 
Lages.Aspills fall .hrou^azone,.heyol..n^Ughtfto.nane.ni«er 122 U^tisincKle^^ 
Jora,lof,hepixelsof.hephoto-de,ec.orsl24.hatarede<i.edwi.hi„.ha.zon.Duru,g».^ 

scan of aU the pixels in a zone, a quantitative value representing the degree of dartaess or ^ 

incident on a pixel is ohtained Since reflections, shadows and other such phenomenon may 

l..erf^wi,h.he,nminanceofapixe,.cer.^.hresholdsarees.ahlished.E^^ 

me five sections ofme sensing zonehasanassociatedhighandlow threshold valu.mep.xel 

processors 204 consider a pixel to be blocked it the pixel's light value exceeds d.e h.gh 
Lshold. The scanned valued for each pixel is compared against the threshold value, at step 
418. The threshold values are provided prior to the scamiing operation. 

,00591 Turning to FIG. 6B. a screen U displayed wherein threshold values for each of the one 
Ldredtwentyei^tpixelswiti,inasectioncanbespeciiied.h.anemhodimen.of^cpresent 

luventio^anoptionisprovidedtoenableausertosetadeWtthresholdvalueforallp^e^^^ 
While both a low and high threshold can be specified, dte preferred embodmrent utiltzes ,ust the 
high threshold value. 

,00601 Ats.ep420.thedetenninadonismaderegardingwhe,herti,epixelvalueexceedsthe 
L,holdvalue.«thepixelv.«edoesnotexceedthethresholdvalue.the„^a.pixel,s^^^^ 
for purposes of pixel counts. Conversely, if the pixel value exceeds the threshold value, t^en ti.e 
p Jl is counted and included in the overall pixel conn, for the MItog object. Tlte accumu a^^ 
pi.elooun.sarestoredbyindividualzonecoun.ers.T.eaccum„latedpixelcountfor.hefidh^ 

object is compared to a previously determined count of pixels for the anticipated object or m thrs 
easetirepiUthatisbeingbottled. As would be understood by one skilled in the art. such a 
comparison involves performing some statistics on the various values and taking mte account 
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certain degrees of deviation. Ifi, is determined tot ftere is a match «tt>in the ac^ptable 
deviation limits, processing continues .o step 412 of FIG. 4A. On the other hand, it there rs no 
match, processing continues to step 414 of FIG. 4A. 

,00611 If the object image is determined to be 'valid' i.e. it is recognized as a pill by step 410, 
.hen an accumulator value of piU counts is incremented, a. step 412. A validpiU is defmed as a 
pill whose pixel counts and pixel scans Ml with a predet«mined valid range, as defined to the 
system Qualification values are specified to the system as maximum/minimum scans and 
maximum/minimum pixel. A screen illustrating vaUd counts for each zone within each secon rs 
shown in FIG. 6C and referenced as display 604. 

,00621 Conversely, ifthefanage is no, 'valid' i.e.i, is unrecognized as a pill by step 410, the., a 
count forbad images is accumulated. lUe image is also stored to a bad image buffer a. step 414. 
As pills drop through zones, individual zone counter, accumulate the number of invahd prxel 
images. An invalid pill is defined as a pill whose pixel counts and pixel scans Ml outs.de the 
valid range as defined to the system. Pixel counts and scans also provide infonnafion on the M 
time, width and other aspects of the object. A screen illustrating invalid zone counts is iUusttated 
m FIG. 6D and referenced as display 606. 

,00631 In conjunction with gathering pixel values, the system and method of the present 
invention also provides images of dre passmg pills. TTie analog values of eachpixel maybe 
transferred to an image screen for display as a gray scale image, as iUustrated in FIG 6E. In 
operation, an operator can select to dUplay the image from a zone withm a particular section. 
Following ™eh selection, the displayed object image for the zone is ^dated as fast as objects 
are counted. 

100641 In a firt.er embodiment of tt.e present invention, the a«,uired images may be utilized to 
determine the opacity of an object. For example, in a case where the Mling objects are capsules, 
the luminescenceofthepixels can be direcdycorrelatedtohethe opaqueness of.hecapsule.hus 

indicating whether a capsule is empty or foil. 
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[0065] Certain features described thus far are made possible by a number of pre-configured 
parameters and various settings for the operating enviromnent. FIG. 5 illustrates a screen display 
500 in which some of the pre-configuration takes place and various parameters are specified. 
For example, pixel processor command 502 allows the setup of individual pixels via a 
communications interface. A command is selected and then the appropriate parameters are 
supplied in other fields on the screen. A case in point is the setting of the object trigger event 
504 that initiates the scanning process. 

[00661 Various communications modes 504 can be selected for the system. As shown there is an 
object detection mode, which is the normal operating and pill counting mode. A grayscale 
diagnostic mode allows zones and dividers to be viewed in real time, thus enabling the 
appropriate setting of pixels as was earlier described. Binary scan mode displays a fiiU selection 
of pixels in black and white. Black pixels have levels that exceed the individual pixel thresholds 
that are defined on the threshold screen of Fig. 6B. Image acquisition allows the zone image of a 
single tablet to be displayed as the tablet falls through in real time. 

[0067] A sensor section field 508 allows parameters to be provided for each of the sections in the 
system. As previously described, there are 5 sections in the preferred embodiment, each being 
eight inches in length and having 128 pixels. A setup section button 510 allows all sections to be 
set up with one command. 

[0068] The zone fields 5 1 2 represent the possible zones zero to thirty-one that may exist within 
each of the five sections. When an object is detected, the system displays the zone, size in 
number of pixels, and scans - number of scan lines in the object image, and these values are 
represented in screen area 514. In comiection with the object scan and as previously discussed, 
there are a number of parameters associated with a scamied object that must be satisfied in order 
for the obtained image to be considered vaUd. Tliese parameters, minimum and maximum scan 
lines and minimum and maximum pixel counts are also made accessible through tiie diagnostic 
screen 500. 
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[00691 Yet another feature of the present invention is the ability to map bottles. As bottles fall 
through zones, they are physically shuttled into bottles. Zone mapping is the definition of which 
zone feed tablets into which bottles, hi the described embodiment of the present invention, the 
slat machine fills twenty bottles at a time. Because there are five sections, each section tracks the 
filling of four bottles. As such, in each section, zones 1-5 fill bottle number one, zones 6-10 fill 
bottle number 2, 1 1 - 15 fill bottle number 3 and zones 16-20 fill bottle number 4. This ability to 
map bottles to zones provides the flexibility of the present invention and enables it to adapt to 
different enviromnents. The system and method of the present invention is able to maintain 
bottle counts for a vast number of bottles simultaneously. In the preferred embodiment, twenty 
bottle comits were maintained with the ability to maintain up to approximately fifty bottles. 

[00701 The details of the processing described above will next be described in reference to a 
specific embodiment of the present invention utiUzed for comiting pills. In an embodiment of the 
present invention, a Microchip PICl 8F252 processor with a 40.0 MHz oscillator is utilized as the 
pixel processor 204 for each 1" wide linear array of pixels. A single communications controller 
processor 208 operates as a slave device to 8 co-operating master pixel processors 204. The 
controller processor 208 generates a 16 kHz clock pulse utilized to decode 8 pixel conversion 
and communications states and 4 emitter 122 drive states for the IR emitter LED array. 

[0071] Each clock pulse starts a two-pixel conversion and evaluation cycle. The eight pixel 
processors 204 are each allocated one of the eight states for communicating the results of the 
previous 16 pixel conversions and evaluations to the controller processor 208. Additionally a set 
of up to thirty-two pixels may be selected fi:om the entire 8-inch linear array to produce grayscale 
pixel diagnostic data. The selection of the diagnostic pixels is determined by the controller 
processor and is segmented into multiple 4 contiguous pixel blocks. 

[0072] The 16 kHz clock produces a 62.5 microsecond window in which two A/D conversions 
must be completed by each of tiie 8-pixel processors 204. The pixel processors 204 transmit 8 
bytes of data per 62.5 microsecond period in two 4-byte packets. The eight bytes will always 
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consist of 4 bytes of binary scan data for the selected master pixel processor, and four bytes of 
diagnostic grayscale data from a dynamically selectable block of 4 contiguous pixels anywhere 
in the 8" anay. The slave controller processor 208 thus has the opportunity to transmit up to two 
4 byte communications packets on the SPI interface every 62.5 microseconds in response to the 
master pixel processor 204 data packets. 

[0073] The A/D converters 202 are comiected to the synchronous UART interface of the slave 
processor 208 and support a clock rate up to 2 MHz. For each conversion the slave processor 
208 generates a one-byte A/D control byte and clocks in a one-byte 7-bit conversion resuh. It 
takes a minimum of 16 clock states per conversion. Two conversions plus two clock states for 
miscellaneous control bit updates requires 17 microseconds (34 clock states). 

[0074] The pixel processor 204 operating at 40.0 MHz executes at 10 million instructions per 
second. Each instruction takes 100 nanoseconds therefore 625 instructions may be executed per 
62.5 microsecond window. In order to communicate 8 bytes of data between the controller 
processor and the pixel processors 204 it is therefore necessary to communicate a byte every 78 
instruction cycles (625 / 8). The maximum SPI interface rate is 10 MHz, which means it takes a 
minimum of 8 instruction cycles to transmit and receive a single byte on the SPI interface. At 
this rate the object detection and pixel counting code must be extremely efficient, and the 
communications code to interface with adjacent controller processors and the single overall host 
processor must require minimal overhead. Preferably, the pixel processor 204 sets up the first 
byte to be transmitted and then utilizes the transmit completion flag to trigger the setup of the 
subsequent three bytes of the 4 byte packet. To further pipeline the communications performance 
the 4 byte packet of binary pixel data is transmitted during the 1^' A/D conversion process for the 
current scan and then the 4 byte packet of grayscale diagnostic data is transmitted during the 2"^ 
A/D conversion process. 

[00751 A pixel processor 204 should detect each high to low transition of the 16 kHz pixel clock 
input, and then poll the ENB and SYNC inputs to determine the pixel A/D conversion cycle 0-7, 
and its own processor ID (0-7) used to gate communications packets. Additionally the pixel 
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processor 204 must decode the incoming 4 byte packets to handle selection of diagnostic pixels, 
setting of grayscale thresholds, establishment of pixel grayscale baseline, and other configuration 
data. 

[00761 The timing may be designed to allow the SPI communications to be handled in 4 byte 
bursts with minimal wasted processor clock cycles to allow as large as possible a code fragment 
to be executed while not handUng communications. It is preferable to limit mcoming control 
packets to the pixel processors 204 to one 4 byte packet per 16 kHz clock period and utilize the 
other incoming 4 byte packet as a dummy packet. 

[00771 In a further embodiment of the present invention, it may be desirable to communicate an 
entire 4 byte SPI packet back and forth between the controller 208 and a pixel processor 204 
during the transmission of the control byte to the A/D converters 202. Assuming 8 instructions 
per SPI byte it requires 32 instruction cycles to transmit the 4 byte packet, the AAD converter 
clock is 2.0 MHz and thus it takes 40 instruction cycles to transmit a byte to the A/D converter. 
It may be possible to slightly increase the sample time of the A/D converter 202 and increase the 
number of clock cycles to sUghtly more than 40 per control byte to handle master slave 
synchronization. 

[00781 During the reception of the A/D result, incoming control packets can be parsed and acted 
upon. During a subsequent A/D conversion another control packet may be accepted and a 4-byte 
grayscale diagnostic packet transmitted. Prior to performing A/D conversions at the start of a 
scan (A/D conversion cycle 0) the grayscale pixel data from the previous scan and buffer the data 
are evaluated. 

[00791 It is estimated that Controller Processor 208 to Core Module RS485 Communications 
would occur at approximately 230 Kbaud. 
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[0080) In the preferred embodiment of the present invention, the following bit maps ■ 
implemented in the oommunication between the Ethernet core processor 210 and the controUer 
processor 208: 



IByte 



Bit 8 - Always ' 1 ' to indicate this is from Core to Controller 

Bit 7..5- Controller Address Bits ^ ^ . n 

Rit7 5= 000 Data Nibble to previously addressed Controllercsj 

001 Start of message to Controller #1, or Immediate Command 

010 Start of message to Controller #2, or Immediate Command 

01 1 Start of message to Controller #3, or Immediate Command 

100 Start of message to Controller #4, or Immediate Command 

101 Start of message to Controller #5, or Immediate Command 

110 Undefined ^ 

1 1 1 Broadcast address, Start of message or Immediate Command to 

All Controller's 



Bit 4 - Start of Message Flag 

Bit 4= 1 Start of Message 

0 Immediate Command or Packet Data Nibble 

Bit 3 0 - Nibble Count, Immediate Command, Packet Data Nibble 
Bit 3 0- Nibble Count if Bit 4 Start of Message Flag is 1 
Bit3..0-PacketDataNibbleifBits7..4 = '0000' 
Bit 3 0- Immediate Commands if Bit 4 Start of Message Flag is 0 

And Bits 7..5 0 '000' 

Bit3..0= 0000 Sleep Mode, no communications 

0001 Object Detect Mode 

0010 Idle Mode( Pixels 0-7) 

0011 Idle Mode( Pixels 8-15) 

0100 Self Test Mode, Clear Bit Status( failure bits are sticky) 

0101 Self Test Mode( Pixels 0-7) 
0110 Self Test Mode( Pixels 8-15) 

1000 Diagnostic Grayscale Mode( Diagnostic ID 0/1 Data) 

1001 Diagnostic Grayscale Mode( Diagnostic ID 2/3 Data) 

1010 Diagnostic Grayscale Mode( Diagnostic ID 4/5 Data) 

101 1 Diagnostic Grayscale Mode( Diagnostic ID 6/7 Data) 



Packet Messages 

Nibble 1 - Packet ID 

0000 - Lo Threshold Value 

0001 - Hi Threshold Value 

0010 - Self Test Lo Threshold Value 

001 1 - Self Test Hi Threshold Value 
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0100 - Zone Mapping, Each pixel is identified by a Zone ID 0-31 

0101 - Min Object size in pixels 

01 10 - Maximum Object size in pixels 

01 1 1 - Diagnostic Mapping (always use broadcast) 
Nibble 2 - Processor Address, 0-7 

Nibble 3 - Pixel Address, 0-15 

Nibble 4 - Diagnostic ID, 0-7 for diagnostic data selection 

Nibble 6 5 - Data Value or Zone ID ^ . ,i ^7 a 

Zone 32-63 is considered Zone 32 and passed to adjacent Gondolier Zone 0 
Zone 128-255 marks a disabled pixel and is not evaluated, used for divida^s 

8 Bytes 

Bit 8 - Always '0' to indicate this is firom ControUer to Core 
Bit 7..0- Data 8-bit 

Diagnostic Grayscale Data, 4 packets requested round robin fashion per Controller 
Diagnosuc uray^ Pixel Griys^e Data (pixels selected by Immediate Command) 

Object Data, 

Byte 1 - Zone 0-31 

Byte 2 - Status( Good object, Undersize, Oversize) 

Byte 3 - Scans( 0-256) 
Byte 5.-4 -Pixels( 0-65536) 
Byte 8..6 - Unused all 'O's 

Self Test Data, 2 packets requested round robin fashion 
Byte 1 - Pixel Processor 0 Pass/Fail Bits 

Bit 7..0 Pixel Pass/Fail Status 0 = Pass, 1 = Fail 
Byte 2 - Pixel Processor 1 Pass/Fail Bits 
Byte 3 - Pixel Processor 2 Pass/Fail Bits 
Byte 4 - Pixel Processor 3 Pass/Fail Bits 
Byte 5 - Pixel Processor 4 Pass/Fail Bits 
Byte 6 - Pixel Processor 5 Pass/Fail Bits 
Byte 7 - Pixel Processor 6 Pass/Fail Bits 
Byte 8 - Pixel Processor 7 Pass/Fail Bits 

Idle Data, 2 packets requested round robin fashion 
Byte 1- Pixel Processor 0 Black/White Bits 

Bit 7..0 Pixel BlackAVhite Status 0 = White, 1 = Black 
Byte 2 - Pixel Processor 1 Black/White Bits 
Byte 3 - Pixel Processor 2 Black/White Bits 
Byte 4 - Pixel Processor 3 Black/White Bits 
Byte 5 - Pixel Processor 4 BlackAVhite Bits 
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Byte 6 - Pixel Processor 5 Black/White Bits 
Byte 7 - Pixel Processor 6 Black/White Bits 
Byte 8 - Pixel Processor 7 Black/White Bits 
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[00811 It is necessary that there is time synchronization between the controllers 208 for pixel 
sharing. Each controller 208 has two 3 pin TTL level output connectors for pixel and timing 
synchronization. THe #1 Controller generates a 16 kHz pixel clock, which is output on the 3-pm 
Pixel Sharing Output comiector along with a Shared Pixel Data output and Ground signal. 

[00821 Subsequent controllers detect transitions of the pixel clock signal and sense the Shared 
Pixel Data state on the 3.pin Pixel Sharing Input connector. The controller uses the 16 kHz clock 
input to shift in up to 8 shared pixels and to synchronize its timing with the previous controller. 
The subsequent controller produces the same pixel and timing synchronization signals on its 3- 
pm Pixel Sharing Output comiector. A continuous timing synchronization chain is formed 
between the five co-operating controllers using this mechanism. 

[00831 Low to High transitions on the clock output are detected to establish timing 
synchronization, and High to Low transitions on the clock output are used to sample the shared 
pixel data states. If a break in the timing chain is likely or anticipated it would be possible to 
connect the five controllers in a star configuration instead of daisy chained. 

[00841 Importantly, timing synchronization must be maintained between all the processors and 
the emitter drive pattern generated by controller #1 . This is accompUshed by superimposing a 
sync pulse onto the pixel data during the clock High state. The pixel data signal would by default 
be set low during the clock High state and then revert to the pixel data state prior to the High to 
Low transition of the clock used to sample the pixel data. THe data line would be set High only 
on the first ADC conversion cycle of the current scan and sampled during the clock High state to 
control state synchronization. The slaved controller 208 must be able to detect the Low to High 
transition of the 16 kHz clock signal and adjust its timing accordingly to limit the time difference 
between the reference clock and the internally generated clock to 5-10 instruction cycles. 
Writing a temporary new PR2 register value allows the 16 kHz clock period to be varied on the 
fly to adjust the timing in small increments. Using the incoming clock to generate interrupts on 
RBO at high priority and then reading TMR2 allows the synchronization to be measured given a 
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known fixed interrapt latency. PR2 is then updated for the next cycle based on the timing 
measurement. 



[00851 The various features and screen examples shown and discussed above illustrate the novel 
features of the counting system of the present invention. A user of the present invention may 
choose any of the above features or an equivalent thereof, depending upon the desired 
appUcation. In this regard, it is recognized that various forms of the subject systems could be 
utilized without departing firom the spirit and scope of the present invention. 

[0086] As is evident from the foregoing description, certain aspects of the present invention are 
not Umited by the particular details of the examples illustrated herein, and it is therefore 
contemplated that other modifications and appUcations, or equivalents thereof, will occur to 
those skilled in the art. It is accordingly intended that the claims shall cover all such 
modifications and applications that do not depart firom the sprit and scope of the present 
invention. 

[00871 Other aspects, objects and advantages of the present invention can be obtained from a 
study of the drawings, the disclosure and the appended claims. 
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